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AFOSR  FINAL  REPORT 

Nonlinear  Control  Systems 
AFOSR  Grant  No.  -  91  -  0266 

Period:  October  15,  1991  -  October  14,  1994 


1  Abstract 

The  ability  to  systematically  control  dominant  nonlinear  effects  in  the  evolution  of  com¬ 
plex  dynamical  systems  is  an  important  research  goal,  with  applications  in  several  existing 
and  emerging  DOD  research  and  development  programs.  The  research  we  describe  here  is 
aimed  at  the  development  of  a  control  methodology  for  lumped  and  distributed  parameter 
systems,  similar  in  scope  and  applicability  to  classical  automatic  control  design  for  lumped 
linear  systems.  This  program  is  aimed  at  the  systematic  development  of  feedback  design 
methodologies  for  shaping,  or  at  least  influencing,  the  response  of  a  broad  class  of  nonlinear 
systems. 

2  Proposed  Research  Objectives 

The  main  objectives  of  this  three  year  research  effort  were  concerned  with  the  control  of 
nonlinear  lumped  and  distributed  parameter  systems.  This  program  was  aimed  at  the  sys¬ 
tematic  development  of  feedback  design  methodologies  for  shaping,  or  at  least  influencing, 
the  response  of  a  broad  class  of  nonlinear  systems. 

Our  optimism  in  pursuing  this  research  program  was  based  on  a  general  maturing  of  the 
field  of  nonlinear  control,  including  a  remarkable  spectrum  of  results  on  feedback  stabilization 
and  in  shaping  the  response  of  lumped  nonlinear  systems.  Our  first  explicit  research  task 
was  concerned  with  the  solution  of  the  problem  of  designing  feedback  controllers  achieving 
the  important  control  objectives  of  asymptotic  tracking  and  disturbance  attenuation. 

Task  2.1  The  formulation  and  derivation  of  conditions  implying  the  well-posedness  of 
the  output  regulator  problem  for  nonlinear  control  systems. 

In  the  standard  formulation. of  the  output  regulator  problem,  finite  dimensional  models  for 
the  signal  and  for  the  disturbance  generators  are  assumed  known.  While  this  is  typically  the 
case  for  certain  classes  of  signals  to  be  tracked,  it  can  not  always  be  assumed  for  disturbance 
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signals.  For  this  reason,  we  refined  Task  2.1  to  include  robustness  against  unstructured 
uncertainties,  leading  to  the  formulation  of  a  robust  disturbance  attenuation  problem. 

Task  2.1(bis)  The  formulation  and  derivation  of  conditions  characterizing  the  existence 
of  a  robust  regulator  for  a  nonlinear  system. 

The  next  task  extended  Task  2.1  in  a  different,  but  equally  important,  way  representing 
the  development  of  a  nonequilibrium  theory  of  output  regulation. 

Task  2.2  The  development  of  a  nonlinear  regulator  theory  valid  globally  or  at  least  on  a 
priori  given  bounded  neighborhoods  W  of  ( 0,0)  in  Rn  x  Re. 

The  next  task  dealt  with  the  development  of  a  theory  of  output  regulation  which  would 
enable  tracking  and  disturbance  attenuation  for  broader  classes  of  signal  generators  exhibit¬ 
ing  more  complicated  nonlinear  behavior. 

Task  2.3  The  development  of  a  regulator  theory  valid  for  tracking  or  rejecting  signals 
generated  by  exosystems  which  are  not  necessarily  “neutrally  stable”,  including,  for  example, 
exosystems  which  have  stable  limit  cycles,  invariant  tori,  etc. 

Task  2.4  is  focused  on  the  development  of  a  global  output  regulator  using  dissipation  of 
energy,  or  passivity,  as  the  underlying  stability  mechanism. 

Task  2.4  The  formulation  and  derivation  of  conditions  implying  the  existence  of  a  solu¬ 
tion  of  the  tracking  problem,  and  the  nonlinear  regulator  problem  for  a  plant  which  is  feedback 
equivalent  to  a  passive  system. 

From  a  feedback  design  point  of  view,  beyond  the  rigorous  solution  of  the  nonlinear 
regulator  problem,  a  very  important  component  of  the  proposed  research  was  the  actual 
form  of  the  feedback  compensation  and  whether  it  would  be  computationally  tractable.  In 
the  linear  case,  the  structure  of  the  feedback  law  is  that  of  a  proportional  error  compensator 
where  the  feedback  “gains”  can  be  computed  “off-line”  by  solving  a  Sylvestor  equation,  quite 
similar  to  very  important  roles  played  by  the  Riccati  equation  in  linear  quadratic  regulator 
design.  This  fact  motivated  our  next  series  of  tasks  dealing  with  the  solution  of  nonlinear 
optimal  control  problems  by  feedback  laws  which  would  involve  the  “off-line”  solution  of 
nonlinear  PDE’s.  Our  preliminary  calculations  indicated  that  an  existence  theory  could  be 
developed  for  such  equations  in  the  context  of  Lagrangian  analysis. 

Task  2.5  Using  the  methodology  of  Lagrangian  distributions,  develop  sufficient  conditions 
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for  the  existence  of  an  “ off-line ”  characterization  of  globally  defined  optimal  feedback  control 
laws  for  the  finite  horizon  regulator  problem. 

Our  next  explicit  research  task  focused  on  the  application  of  Lagrangian  methods  to 
infinite  time  horizon  problems. 

Task  2.7  The  development  of  existence  criteria  and  “off-line”  characterizations  of  global 
optimal  feedback  laws  for  the  infinite  time  optimal  regulation  problem. 

An  important  part  of  our  effort  in  lumped  nonlinear  feedback  control  was  concerned 
with  the  design  of  nonlinear  feedback  laws  which  stabilize  a  given  nonlinear  control  system. 
We  have  developed  a  program  aimed  at  establishing  a  design  methodology  for  asymptotic 
stabilization  of  continuous-time,  affine  nonlinear  systems  in  the  large,  based  on  the  nonlinear 
dynamics  concept  of  system  transmission  zeros  -  the  notion  of  zero  dynamics.  The  next  task 
focused  on  an  extension  of  this  concept  and  technique  to  the  class  of  nonaffine  systems. 

Task  2.8  The  development  of  zero  dynamics  for  general  nonlinear  systems,  including 
existence  theorems  and  algorithms  for  computing  nonlinear  zero  dynamics. 

Zero  dynamics  methods  typically  have  been  developed  under  some  tacit  regularity  as¬ 
sumptions.  The  final  two  explicit  research  tasks  for  lumped  nonlinear  systems  focused  on 
the  development  and  extension  of  this  methodology  to  singular  problems. 

Task  2.9  The  development  of  singularly  perturbed  models  for  the  zero  dynamics  of  mul¬ 
tivariable  nonlinear  systems  having  nonuniform  (vector)  relative  degree,  and  the  design  of 
feedback  laws  achieving  stabilization,  asymptotic  tracking  or  disturbance  rejection  for  systems 
having  non-uniform  relative  degree. 


Task  2.10  We  propose  a  systematic  development  of  singular  and/or  global  problems  in 
noninteracting  control  based  on  the  use  of  methods  from  the  theory  of  singularities,  e.g. 
“blowing  up,  ”  together  with  the  use  of  global  differential  geometric  methods,  e.g.  from  the 
emerging  theory  of  noncommutative  differential  geometry,  to  determine  solvability  for  arbi¬ 
trary  foliations  A. 

Task  3.1  and  Task  3.2  focus  on  one  of  our  longer  term  goals  in  the  second  part  of  this 
research  project,  the  development  of  a  systematic  feedback  design  methodology  for  nonlinear 
distributed  parameter  systems  which  would  retain  some  of  the  intuitive  appeal  of  classical 
automatic  control  in  a  spirit  similar  to  the  program  pursued  for  the  control  of  lumped 
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Task  3.1  The  development  of  a  systematic  feedback  design  methodology  for  the  stabiliza¬ 
tion  of  minimum  phase  nonlinear  distributed  parameter  systems.  In  particular,  the  develop¬ 
ment  of  the  concept  of  zero  dynamics  and  of  “ instantaneous  gain”  for  nonlinear  distributed 
parameter  systems  and  of  a  feedback  design  theory  based  on  asymptotic  properties  of  the  zero 
dynamics. 

Task  3.2  The  development  of  a  root-locus  design  methodology  for  linear,  parabolic  dis¬ 
tributed  parameter  systems.  In  particular,  the  development  of  concepts  of  instantaneous  gain 
and  the  use  of  zero  dynamics  to  design  asymptotically  stabilizing  feedback  laws  for  minimum 
phase  systems. 

Another  of  our  long  term  goals  is  described  in  Task  3.3  in  which  we  proposed  the  devel¬ 
opment  of  a  design  methodology  capable  of  shaping  the  response  of  distributed  parameter 
systems.  In  particular,  we  are  interested  in  the  problem  of  output  regulation  for  distributed 
parameter  systems  in  the  sense  described  above  for  lumped  nonlinear  systems.  As  in  this 
case,  we  expect  the  main  ingredients  in  the  solution  of  this  problem  to  be  the  design  of 
stabilizing  feedback  laws  and  the  development  of  a  theory  of  steady  state  response  for  stable 
distributed  parameter  systems.  The  research  described  so  far  is  aimed  at  the  solution  of  the 
first  problem.  For  a  class  of  linear  parabolic  systems  we  have  been  able  to  analyze  the  steady 
state  response  of  an  asymptotically  stable  system.  Based  on  this  work,  we  expect  to  be  able 
to  solve  the  problem  of  output  regulation  for  this  class  of  control  systems  and  for  a  linear  ex¬ 
ogenous  system.  In  the  nonlinear  case,  the  development  of  a  theory  of  steady  state  response 
is  known  to  rely  quite  heavily  on  center  manifold  theory,  which  is  still  available  in  infinite 
dimensions  and  would  apply  whenever  the  exogenous  signal  generator  is  finite  dimensional. 
This  problem  formulation  would  be  of  particular  interest  for  flow  control,  either  in  the  case 
where  a  reduced  order  finite  dimensional  model  for  the  relevant  features  of  a  fluid  flow  is 
available  or  in  the  case  where  a  finite  dimensional  attractor  or  inertial  manifold  for  the  flow 
dynamics  is  known  to  exist. 

Task  3.3  The  development  of  a  theory  of  output  regulation  for  distributed  parameter 
systems  and  its  application  to  problems  of  asymptotic  tracking  and  disturbance  attenuation. 
In  particular,  the  development  of  methods  for  the  analysis  of  steady  state  response  of  stable 
nonlinear  systems  to  signals  produced  by  lumped  nonlinear  exogeneous  systems. 

Because  of  its  importance  as  a  fundamental  stability  mechanism  for  lumped  nonlinear 
systems,  in  the  next  task  we  proposed  the  rigorous  formulation  of  the  concept  of  dissipation 
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of  energy  for  input-output  systems. 

Task  3.4  To  develop  intrinsic  characterizations  of  those  distributed  parameter  systems 
which  are  dissipative  or  passive.  In  particular,  for  linear  systems  to  derive  criteria  for 
dissipativity  in  terms  of  positive  reality  of  the  transfer  function  and  in  general  to  establish 
the  Kalman-  Yacubovitch-Popov  Lemma  for  distributed  parameter  systems. 

Our  final  explicit  research  task  was  the  understanding  of  a  more  robust  version  of  feedback 
linearization,  viz.  feedback  equivalence  to  a  passive  system. 

Task  3.5  The  development  of  conditions  for  feedback  equivalence  of  a  distributed  parame¬ 
ter  system  to  a  passive  or  dissipative  system.  Moreover,  the  derivation  and  the  computation 
of  explicit  feedback  laws  rendering  a  given  system  dissipative. 


3  Status  of  the  Research  Effort 

The  ability  to  systematically  control  dominant  nonlinear  effects  in  the  evolution  of  complex 
dynamical  systems  is  an  important  research  goal,  with  applications  in  several  existing  and 
emerging  DOD  research  and  development  programs.  The  research  we  describe  here  is  aimed 
at  the  development  of  a  control  methodology  for  lumped  and  distributed  parameter  systems, 
similar  in  scope  and  applicability  to  classical  automatic  control  design  for  lumped  linear 
systems.  Accordingly,  there  have  been  two  closely  allied  themes  which  we  have  pursued, 
having  their  origin  in  two  approaches  to  the  control  of  complex  dynamical  systems  -  the 
analysis  and  control  of  as  accurate  a  system  description  as  possible,  and  the  alternative 
development  of  reduced  order  models,  which  capture  some  of  the  dominant  dynamical  effects 
and  require  the  consequent  development  of  high  performance  controllers  which  either  are 
more  robust  with  respect  to  unmodeled  dynamics  or  which  can  adapt  to  unknown  parameter 
fluctuations  in  the  reduced  order  model. 

The  main  objectives  of  this  three  year  research  effort  are  concerned  with  the  control  of 
nonlinear  lumped  and  distributed  parameter  systems.  This  program  is  aimed  at  the  sys¬ 
tematic  development  of  feedback  design  methodologies  for  shaping,  or  at  least  influencing, 
the  response  of  a  broad  class  of  nonlinear  systems.  Our  optimism  in  pursuing  this  research 
program  is  based  on  a  general  maturing  of  the  field  of  nonlinear  control,  including  a  remark¬ 
able  spectrum  of  results  on  feedback  stabilization  and  the  application  of  geometric  methods 
to  the  unanticipated  solution  of  the  problem  of  designing  feedback  controllers  achieving  the 
important  control  objectives  of  asymptotic  tracking  and  disturbance  attenuation. 

An  important  part  of  this  research  effort  in  nonlinear  feedback  control  is  concerned  with 
the  design  of  nonlinear  feedback  laws  which  stabilize  a  given  nonlinear  control  system,  ei- 
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ther  about  an  equilibrium  or  an  attractor.  For  the  equilibrium  theory,  we  have  recently 
made  significant  progress  in  establishing  a  design  methodology  for  asymptotic  stabilization 
of  continuous  time  systems  in  the  large  [5,  6],  based  on  the  nonlinear  dynamics  concept  of 
system  transmission  zeros  -  the  notion  of  zero  dynamics  and  its  relationship  to  more  classical 
notions  such  as  passivity.  In  [29],  the  zero  dynamics  approach  is  applied  to  develop  rigorous 
underpinnings  for  a  stabilization  scheme  which  is  widely  used  in  the  commercial  aerospace 
industry  -  the  method  of  inner  loop  -  outer  loop  design.  A  more  complete  treatment  of 
this  development  will  be  available  in  the  forthcoming  Washington  University  Ph.D.  thesis 
by  John  Roltgen. 

Interest  in  the  development  of  a  systematic  methodology  for  nonequilibrium  stabilization 
is  becoming  more  widely  appreciated  as  the  benefits  to  taking  advantage  of  dominant  non¬ 
linear  effects  have  become  more  apparent.  Examples  include  the  use  of  nonlinear  feedback 
gains  to  produce  or  to  attenuate  the  effects  of  limit  cycles.  In  [27],  which  has  recently  won 
the  1993  IFAC  Automatica  Best  Paper  Award,  an  enhancement  of  the  geometric  methodol¬ 
ogy  developed  for  the  equilibrium  case  is  applied  to  the  derivation  of  feedback  laws  to  induce 
a  stable  limit  cycle  in  the  center  manifold  of  a  rigid  spacecraft  system  which  cannot  be 
asymptotically  stabilized  about  a  reference  equilibrium,  even  by  nonlinear  feedback.  There 
are  also  interesting  applications  of  such  techniques  to  eliminating,  or  at  least  attenuating, 
hysteresis  in  rotating  compressor  stall.  A  nonlinear  control  law  attenuating  the  effects  of 
this  hysteresis  loop  has  been  designed  in  ([3],  [4])  using  the  nonlinear  terms  to  shape  the 
flow  on  a  center  manifold  by  taking  advantage  of  a  limit  cycle  which  is  produced  through  a 
Hopf  bifurcation. 

As  an  initial  result  in  this  research  effort  we  have  recently  derived  a  theorem  character¬ 
izing  the  existence  of  globally  asymptotically  stable  compact  attractors  in  terms  of  feedback 
equivalence  to  passive  systems,  for  a  suitable  choice  of  system  output.  This  result  promises 
to  have  interesting  corollaries  extending  our  previous  application  involving  feedback  stabi¬ 
lization  of  limit  cycles,  as  well  as  for  more  general  attractors.  There  are  of  course  many 
situations  of  interest,  e.g  tracking  and  regulation,  where  the  system  output  (e.g.,  position 
or  tracking  error)  cannot  be  treated,  or  redefined,  as  a  design  parameter  but  rather  needs 
to  controlled  to  a  given  value.  In  this  case,  passivity  constructions  cannot  be  used  directly 
if  the  relative  degree  of  the  system  output  is  higher,  as  is  typically  the  case  for  the  position 
variables  for  a  mechanical  system.  In  such  cases,  we  would  still  like  to  take  advantage  of  any 
compact  attractors  in,  or  Lyapunov  stability  of,  the  zero  dynamics  determined  by  the  desired 
output  constraint  for  the  purpose  of  designing  a  locally  asymptotically  stabilizing  law  for  a 
compact  attractor.  Here,  however,  examples  suggest  that  uniform  stability  of  the  attractor 
may  not  always  obtain  and  hence  Lyapunov  functions  for  the  attracting  set  may  not  exist. 
To  this  end,  in  the  recently  completed  manuscript  [30],  a  new  integral  invariance  principle  is 
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derived,  starting  from  properties  of  passive  systems,  for  general  nonlinear  systems,  general¬ 
izing  the  invariance  principle  of  LaSalle  and  especially  suitable  for  nonlinear  control  systems 
with  observation  functions.  The  integral  invariance  principle  results  in  a  broad  spectrum  of 
stabilization  results  which  interrelate  stability,  observability  and  the  converse  theorems  of 
Lyapunov,  but  also  applies  when  Lyapunov  functions  are  not  known  to  exist.  In  addition  to 
providing  a  criterion  for  attractiveness  of  a  set,  we  also  expect  to  be  able  to  use  the  integral 
invariance  principle  to  obtain  stability  results  for  minimal  state  space  realizations  of  non¬ 
linear  systems  described  by  I/O  operators,  for  optimal  control  problems  for  which  the  value 
function  is  not  smooth  or  even  continuous,  as  well  as  for  certain  optimization  problems  with 
nonconvex  Lagrangians  which  arise  in  the  analysis  of  passive  systems  or  in  H°°  design,  as 
discussed  below. 

Our  recent  research  in  the  development  of  methodologies  for  control  system  design  for 
lumped  nonlinear  systems  has  also  concentrated  on  the  development  of  a  systematic  theory 
of  robust  control  and  a  better  understanding  of  underlying  mechanisms  for  taking  advantage 
of  nonlinear  effects  to  shape  the  response  of  complex  systems.  As  a  starting  point,  we  recall 
that  one  of  the  classical  problems  which  involves  shaping  the  response  of  a  system  is  output 
regulation,  in  which  the  objective  is  that  of  controlling  a  plant  in  order  to  have  its  output 
track  (or  reject)  exogenous  commands  or  disturbances.  An  extension  of  the  geometric  non¬ 
linear  design  methodology  discussed  above  to  the  important  problems  of  asymptotic  tracking 
and  disturbance  rejection  has  been  treated  by  the  principal  investigators  in  a  series  of  journal 
papers,  one  of  which  was  awarded  the  1991  George  Axelby  Best  Paper  Award  by  the  IEEE. 
The  nonlinear  regulator  theory  developed  in  [7]  is  valid  in  case  a  model  for  an  “exosystem” 
which  generates  the  exogenous  signal  to  be  tracked  and  the  exogenous  disturbance  to  be 
rejected  is  known.  The  “exosystem”  is  also  assumed  to  be  neutrally  stable,  which  includes 
many  signal  generators  of  practical  interest  (e.g.,  set-point  control,  oscillators  and  almost 
periodic  motion)  but  does  not  allow  for  certain  signal  generators  which  also  have  application, 
such  as  tracking  a  ramp  or  a  limit  cycle.  Even  for  linear  systems,  still  more  challenging  cases 
arise  either: 

when  a  signal  generator  is  known  but  certain  parameters  in  the  system  or  in  the 

disturbance  channel  are  unknown  ( structured  uncertainty );  or 

when  a  signal  generator  for  disturbances  is  not  known  ( unstructured  uncertainty ). 

Both  of  these  problems  are  central  focal  points  in  the  modern  approach  to  robust  control. 
Despite  significant  effort,  for  lumped,  linear  systems  robust  control  for  structured  uncer¬ 
tainties  is  not  nearly  as  well  understood  as  robust  control  for  unstructured  uncertainties. 
Nonetheless,  the  design  of  control  systems  which  are  robust  against  structured  uncertainties 
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is  of  clear  importance  to  many  DOD  objectives,  such  as  the  development  of  flight  controllers 
for  high  angle-of-attack  or  highly  agile  aircraft  which  are  robust  against  nonlinear  variations 
in  the  coefficient  of  lift  or  nonlinear  couplings  between  wind  axis  moments  and  rectilinear 
moments.  In  general,  one  can  always  augment  the  system  dynamics  by  adding  as  new  state 
variables  the  parameters  accounting  for  the  structured  uncertainty.  Of  course,  for  linear 
systems  this  results  in  a  nonlinear  system,  so  that  linear  regulator  theory  cannot  be  directly 
applied  and  one  might  not  expect  a  linear  controller  to  exist.  However,  even  for  nonlinear 
systems  there  arises  a  technical  problem  in  the  application  of  nonlinear  regulator  theory  as 
it  is  presently  formulated;  viz.,  the  parameter  values  are  not  necessarily  observable  or  de¬ 
tectable  through  error  measurements.  A  new  formulation  of  our  approach  to  the  nonlinear 
regulator  problem,  incorporating  the  notion  of  system  immersion,  leads  to  a  new  version  of 
the  concept  of  internal  model  and  no  longer  requires  observability  or  detectability.  Our  pre¬ 
liminary  calculations  suggest  that  this  new  formulation  is  also  valid  for  problems  involving 
unknown  parameters,  enabling  the  derivation  of  conditions  characterizing  nonlinear  solvabil¬ 
ity  to  various  local  and  semiglobal  problems  for  output  regulation  which  are  robust  with 
respect  to  structured  perturbations.  This  development  is  very  promising  and  we  expect  to 
be  able  say  quite  a  bit  more  about  robust  control  for  structured  uncertainties  in  the  future. 

The  problem  of  robust  regulation  with  respect  to  unstructured  uncertainties  is  the  non¬ 
linear  equivalent  of  the  so-called  Hoo-optimal  control  problem,  of  linear  system  theory  (see 
[8]  [9]),  in  which  the  task  of  the  regulator  is  to  minimize  the  maximal  amplitude  of  the  fre¬ 
quency  response  of  the  system,  when  driven  by  disturbance  inputs.  The  solution  of  the 
(sub)optimal  control  problem  via  state-space  methods  was  developed  by  several  authors  over 
the  past  few  years.  In  the  state-space  formulation,  the  problem  of  minimizing  the  H <*>  norm 
(or,  equivalently,  the  L2  gain)  of  a  closed  loop  system  can  be  viewed  as  a  two-person,  zero 
sum,  differential  game  and,  thus,  the  existence  of  the  desired  controller  can  be  related  to  the 
existence  of  a  solution  of  the  algebraic  Riccati  equation  arising  in  linear  quadratic  differential 
game  theory  (see,  e.g.  [10],  [11]  and  [12]).  The  advantage  of  the  state-space  approach  and 
of  the  related  game-theoretic  interpretation  is  that  the  analysis  of  the  Hoc  control  problem 
for  a  linear  system  (namely,  the  characterization  of  necessary  and  sufficient  conditions  for 
the  existence  of  a  solution,  the  construction  of  one  particular  solution  and  the  description 
of  the  set  of  all  possible  solutions)  can  be  rendered  exclusively  dependent  on  time  domain 
arguments,  thus  laying  the  basis  for  appropriate  extensions  to  broader  classes  of  systems. 
This  point  of  view  was  suggested  in  [13]  and  in  [12]. 

In  recent  years,  the  research  efforts  towards  the  development  of  a  “nonlinear  equivalent” 
of  the  ffoo  linear  control  theory  have  gained  momentum  (see  [14]-[19]).  Setting  the  problem  of 
the  attenuation  of  exogenous  disturbances  as  a  nonlinear  differential  game,  the  Riccati  equa¬ 
tion  of  the  linear  H control  is  replaced  by  a  particular  type  of  Hamilton- Jacobi  equation, 


8 


known  as  Isaacs  equation.  As  a  matter  of  fact,  it  has  been  rather  straightforward  to  realize 
that  the  existence  of  a  solution  of  the  appropriate  Isaacs  equation  is  a  sufficient  condition  for 
the  existence  of  a  full-information  feedback  law  providing  disturbance  attenuation,  in  the 
sense  of  the  L2  gain  [14],  [17].  In  addition,  it  has  also  been  shown  that,  under  appropriate 
assumptions,  the  existence  of  such  a  solution  is  a  necessary  condition  for  the  solvability  of 
the  problem  [16]  and  that  the  design  of  a  control  law  based  on  measurement  feedback  is  also 
possible  [17].  This  research  effort  in  nonlinear  disturbance  attenuation  is  currently  being 
developed  jointly  with  researchers  at  McDonnell- Douglas  Aircraft  in  the  design  of  a  missile 
autopilot  for  the  endgame  of  a  low  visibility  missile  which  uses  a  blend  of  reaction  jet  and 
aerodynamical  surface  controls. 

The  state  space  approach  to  the  problem  of  disturbance  attenuation  naturally  entails  the 
consideration  of  a  number  of  basic  research  issues,  which  have  been  only  partially  addressed 
so  far.  One  of  these  is  the  existence  of  a  state-space  characterization  of  the  L2  gain  of  a  sys¬ 
tem.  Illustrated  in  [1],  [20],  [24],  for  the  case  of  linear  systems  and  originally  in  [21],  [22],  [23] 
and  more  recently  in  [16]  for  the  more  general  case  of  nonlinear  systems  affine  in  the  input, 
this  characterization  essentially  provides  the  arguments  to  understand  that  the  existence  of 
solutions  to*  certain  Riccati,  or  Hamilton- Jacobi-Isaacs,  equations  is  a  necessary  condition 
for  the  solvability  of  the  problem  under  consideration.  However,  the  results  available  in  the 
domain  of  nonlinear  systems  are  far  from  being  a  complete  analog  of  the  clear  and  sharp 
picture  which  is  available  for  linear  systems. 

Our  research  [34,  35,  36]  into  the  development  of  a  nonlinear  enhancement  of  H TO  Control 
is  based  on  a  combination  of  the  theory  of  differential  games  and  the  theory  of  passivity  and 
dissipation  for  nonlinear  systems  as  further  developed  in  [6].  The  techniques  in  [34,  35,  36] 
also  use  methods  from  nonlinear  dynamics  to  ensure  solvability  of  the  steady  state  Hamilton- 
Jacobi-Isaacs  equation.  An  analogous  treatment  for  the  finite  time  horizon  disturbance 
attenuation  problem  is  currently  under  development.  Our  preliminary  analysis  shows  that 
solvability  of  the  finite  time  Hamilton-Jacobi-Isaacs  equation  can  also  be  approached  using 
the  geometric  theory  of  Riccati  partial  differential  equations,  pioneered  in  [38,  39,  40].  In 
particular,  [40]  develops  a  rather  complete  geometric  theory  of  classical,  weak  and  generalized 
solutions  to  the  Riccati  partial  differential  equations  arising  in  optimal  control  problems 
of  the  Bolza  and  Lagrange  type.  [41]  announces  necessary  and  sufficient  conditions  for 
the  global  solvability,  i.e.,  the  absence  of  shock  waves  studied  in  [42],  for  Hamilton-Jacobi- 
Bellman  equations  and  for  Riccati  partial  differential  equations.  Details  of  the  proofs  are 
provided  in  [43],  together  with  the  proof  of  a  sufficient  condition  for  the  global  solvability 
of  optimal  control  problems  by  optimal  controls  in  feedback  form.  This  condition,  which  is 
stated  in  terms  of  convexity  and  concavity  properties  of  the  associated  Hamiltonian  function, 
gives  a  complete  nonlinear  enhancement  of  classical  linear  quadratic  theory.  The  combination 
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of  geometric  techniques  with  methods  from  nonlinear  dynamics  can,  however,  also  apply  to 
problems  with  a  non-convex  Lagrangian.  Indeed,  [44]  uses  these  methods  to  give  the  first 
rigorous  proof  of  the  Kalman- Yacubovitch-Popov  Lemma  for  a  class  of  passive  nonlinear 
systems. 

Ultimately,  the  implementation  of  feedback  control  algorithms  will  be  done  in  a  discrete¬ 
time  setting  for  discrete-time  (sample  and  hold)  systems,  the  analysis  of  which  does  not  follow 
immediately  from  the  continuous  time  theory.  References  [45,  46,  47,  48,  49]  represent  our 
initial  efforts  to  extend  this  design  philosophy  to  include  feedback  design  and  stabilization 
of  discrete-time  nonlinear  control  systems.  In  [48],  we  also  establish  a  necessary  condition 
for  feedback  stabilization  of  discrete-time  systems,  similar  to  the  well-known  condition  of 
Brockett  in  continuous  time.  In  [50,  51],  we  develop  the  theory  of  output  regulation  and 
robust  disturbance  attenuation,  respectively,  for  discrete-time  systems  by  a  systematic  use 
of  discrete-time  center  and  stable  manifolds.  A  comprehensive  treatment  of  feedback  design 
for  nonlinear  discrete-time  systems  is  the  subject  of  the  D.Sc.  thesis  by  W.  Lin,  completed 
during  the  second  year  of  this  proposed  research  effort  [26]. 

Of  considerable  practical  interest  is  the  question  of  the  effect  of  boundary  control  in  con¬ 
trolling  or  influencing  the  steady-state  response  of  forced  nonlinear  distributed  parameter 
systems,  such  as  Navier-Stokes  equations,  which  contain  both  nonlinear  convective  terms  and 
diffusive  terms  (see,  for  example  [69]- [79]).  Accordingly,  we  have  developed  design  method¬ 
ologies  in  the  context  of  a  boundary  control  problem  for  the  Burgers’  equation  on  a  finite 
interval.  This  remarkable  system  (see  e.g.  [80])  has  been  studied  for  some  time  ([81])  and  was 
extensively  developed  by  Burgers  ([82])  as  a  simplified  fluid  flow  model  which  nonetheless 
exhibits  some  of  the  important  aspects  of  turbulence.  It  was  later  derived  by  Lighthill  ([83]) 
as  a  second  order  approximation  to  the  one  dimensional  unsteady  Navier-Stokes  equation. 
For  Dirichlet  boundary  conditions,  the  open-loop,  unforced  Burgers’  equation  is,  in  fact, 
exponentially  stable  on  H1  and  the  series  of  papers  [70],  [71]  use  optimal  control  methods 
to  develop  feedback  strategies  which  enhance  stability  on  this  dense  subspace  of  L 2.  In  our 
approach,  we  have  obtained,  in  a  systematic  way,  feedback  laws  which  asymptotically  stabi¬ 
lize  Burgers’  equation  with  Neumann  boundary  conditions  and  for  sufficiently  small  initial 
data  in  L2\  a  case  for  which  the  open  loop  system  is  easily  shown  to  be  unstable.  It  is 
well-  known  [84]  that  the  one- dimensional  Burgers’  equation  with  an  external  forcing  term 
can  be  reduced  by  the  Hopf-Cole  substitution  to  the  one- dimensional  heat  equation  with  a 
“potential”  term,  which  might  seem  to  offer  a  straightforward  method  for  asymptotic  analy¬ 
sis.  However,  for  Neumann  or  radiation  boundary  conditions,  this  substitution  introduces 
quadratic  nonlinearities  at  the  boundary  of  the  interval,  in  sharp  contrast  with  the  case  of 
Dirichlet  boundary  conditions.  Rather  our  analysis  uses  modern  methods  of  attractor  theory 
for  nonlinear  partial  differential  evolution  equations  and  more  closely  follows  the  classical 
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approach  developed  in  [77,  79]  and  in  the  work  [78],  in  which  the  existence  of  the  global 
attractor  for  two-dimensional  Navier-Stokes  equations  was  first  discovered.  Nonetheless,  a 
complicating  feature,  which  arises  for  boundary  conditions  which  are  neither  Dirichlet  nor 
periodic,  is  a  nonlinear  term  which  persists  in  the  energy  balance  relation  and  presents  con¬ 
siderable  difficulty  in  obtaining  a  priori  estimates  from  which  the  existence  of  an  absorbing 
ball  and  the  convergence  of  Galerkin  approximations  can  be  established  as  in  [77,  85]. 

One  of  our  longer  term  goals  has  been  the  development  of  systematic  feedback  design 
methodology  for  nonlinear  distributed  parameter  systems  which  retain  some  of  the  intuitive 
appeal  of  classical  automatic  control  in  a  spirit  similar  to  the  program  pursued  for  the  control 
of  lumped  nonlinear  systems.  In  this  direction,  we  have  recently  found  significant  success  in 
designing  stabilizing  boundary  feedback  control  laws  for  a  controlled  Burgers’  equation  on 
the  basis  of  a  nonlinear  enhancement  of  root-locus  techniques  [86],  [88].  More  explicitly,  in 
our  examples,  we  compute  the  zero  dynamics  for  the  system  and  show  that  these  dynamics 
are  exponentially  stable.  In  the  language  of  lumped  nonlinear  control  theory,  one  would 
say  that  the  nonlinear  system  is  minimum  phase.  Following  classical  design  methods,  in 
[87,  88]  we  implemented  a  proportional  error  feedback  law,  which  we  showed  exponentially 
stabilized  the  system  for  small  initial  data  in  L2.  -  We  have  also  been  able  to  show  that 
a  nonlinear  distributed  parameter  enhancement  of  root-locus  design  still  persists  [89,  90]: 
closed-loop  trajectories  tend  to  a  trajectory  of  the  open-loop  zero  dynamics  as  the  gain 
parameters  are  increased  to  infinity.  Indeed,  for  the  controlled  Burgers’  equation  we  can 
prove  in  the  high  gain  limit  that,  for  sufficiently  small  initial  data  in  L2( 0,1),  the  closed 
loop  trajectories  converge  in  L°°(0,1),  uniformly  in  f  €  [0,  oo)  to  the  trajectories  of  the 
corresponding  zero  dynamics.  The  extent  to  which  this  is  a  general  phenomenon  will  form 
the  nucleus  of  continued  efforts  in  this  area  of  research.  In  particular,  we  expect  to  be 
able  to  develop  systematic  feedback  design  methodologies  for  the  stabilization  of  minimum 
phase  nonlinear  distributed  parameter  systems.  In  this  regard,  we  are  encouraged  by  our 
successful  development  of  this  methodology  for  the  linear  case,  which  is  based  upon  the 
concepts  of  root  locus,  “instantaneous  or  dc  gain,”  and  zero  dynamics,  as  well  as,  a  feedback 
design  methodology  based  on  asymptotic  properties  of  the  zero  dynamics.  Based  on  this 
development  and  similar  success  for  lumped  nonlinear  systems,  we  believe  it  is  possible,  for 
more  general  nonlinear  distributed  parameter  control  problems  with  unbounded  inputs  and 
outputs  and  a  wide  class  of  (boundary)  feedback  laws,  to  determine  convergence  properties 
of  the  closed  loop  trajectories  to  trajectories  of  the  zero  dynamics. 

The  underlying  analysis  for  linear  distributed  parameter  systems  reposes  on  two  new 
ingredients  which  were  formulated  during  the  first  two  years  years  of  this  research  effort. 
The  first  is  based  on  the  discovery  of  a  system  high-frequency  gain  which  is  related  to  our 
earlier  discovery  of  a  system  instantaneous  gain.  The  high  frequency  gain  can  be  obtained  in 
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terms  of  an  appropriate  asymptotic  expansion  of  the  transfer  function  in  a  right  half  plane, 
giving  rise,  in  fact,  to  a  fractional  relative  degree  expressible  as  the  difference  of  the  orders  of 
the  input  and  output  operators  divided  by  the  order  of  the  spatial  operator.  And,  in  analogy 
with  the  finite  dimensional  case  the  instantaneous  gain  can  be  computed  by  an  appropriate 
limit  as  t  goes  to  zero  in  the  impulse  response  function.  We  note  that  in  the  present  case 
the  impulse  response  function  can  be  shown  to  be  an  L 1  function  but  it  is  not  bounded  at 
t  =  0.  Nevertheless,  by  multiplying  by  an  appropriate  fractional  power  of  t,  corresponding 
to  the  system  relative  degree,  we  obtain  the  same  value  for  the  high  frequency  gain  and  the 
instantaneous  gain.  It  is  worth  noting  that  the  sign  of  the  instantaneous  gain  is  all  that 
is  needed  to  determine  the  asymptotic  behavior  of  the  root-locus  plot.  To  this  end,  fairly 
simple  formulae  have  been  developed  for  the  instantaneous  gain,  formulae  which  apply  to 
the  cases  considered  in  [91]  but  are  also  valid  for  a  larger  class  of  control  problems  including 
the  case  of  noncolocated  actuators  and  sensors.  One  special  feature  of  these  formulae  is  that 
they  depend  only  on  the  order  and  coefficients  of  the  highest  order  terms  in  the  input  and 
output  boundary  operators  rather  than  the  more  complicated  determinant  condition  first 
announced  in  [92],  These  results  have  been  extended  in  several  important  directions  in  the 
recent  Ph.D.  thesis  of  Jianqui  He  [25]. 

Much  of  the  stabilization  techniques  reported  above  for  nonlinear  distributed  parameter 
systems  has  been  local,  in  the  neighborhood  of  an  equilibrium.  For  nonlinear  distributed 
parameter  systems,  even  global  existence  of  solutions  is  often  an  open  question,  even  for 
classically  studied  systems.  For  the  Burgers’  system  we  have  studied,  the  zero  dynamics  is 
globally  asymptotically  stable,  so  that  intuition  gleaned  from  the  lumped  nonlinear  theory 
would  suggest  that  appropriate  feedback  laws  might  at  least  generate  globally  defined  tra¬ 
jectories  which  tend  to  some  kind  of  attractor.  Indeed,  our  preliminary  calculations  indicate 
that,  for  the  unforced  Burgers’  system  there  is  a  simple  boundary  feedback  control  law  which, 
for  large  values  of  the  gains,  renders  the  single  equilibrium  of  the  closed-loop  system  globally 
Lyapunov  stable,  and  which  produces  a  compact  attractor  inside  each  closed  ball. 

Finally,  we  also  expect  to  be  able  to  continue  to  make  progress  on  the  problem  of  output 
regulation  for  this  class  of  control  systems  and  for  a  linear  exogenous  system.  In  the  lumped 
nonlinear  case,  the  development  of  a  theory  of  steady  state  response  relied  quite  heavily 
on  center  manifold  theory,  which  is  still  available  in  infinite  dimensions  and  would  apply 
whenever  the  exogenous  system  is  finite  dimensional.  For  these  reasons,  we  expect  to  be 
able  to  make  significant  progress  on  our  third  explicit  research  task,  which  is  devoted  to 
the  development  of  a  theory  of  output  regulation  for  distributed  parameter  systems  and 
its  application  to  problems  of  asymptotic  tracking  and  disturbance  attenuation.  In  this 
connection,  we  are  also  encouraged  by  our  preliminary  calculations  on  global  existence  of 
solutions  to  the  forced  Burgers’  system,  indicating  that  a  regulator  theory  for  nonlinear 
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distributed  parameter  systems  forced  by  disturbances  might,  in  principle,  be  developed. 
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In  addition  to  collaborative  research  with  engineering  research  and  development  personnel 
at  McDonnell-Douglas  Aircraft  Co.,  St.  Louis,  MO,  and  scientific  interaction  with  AFOSR 
personnel  at  Bolling  AFB,  Ft.  Eglin  AFB  and  Wright  Patterson  AFB,  we  have  presented 
many  inivited  lectures  and  colloquia  nationally  and  internationally: 

August  1991 

“Partial  Differential  Equations  and  Nonlinear  Control,”  Invited  lecture  presented 
by  Dr.  Christopher  I.  Byrnes  at  the  AFOSR- Washington  University  Conference 
on  Nonlinear  Control  and  Its  Applications,  St.  Louis. 

“Disturbance  attenuation  in  nonlinear  systems,”  Invited  lecture  presented  by  Dr. 
Alberto  Isidori  at  the  AFOSR- Washington  University  Conference  on  Nonlinear 
Control  and  Its  Applications,  St.  Louis. 

October  1991 

“Tikhonov  Regularization  for  inverse  boundary  control  problems,”  Invited  lecture 
presented  by  Dr.  David  Gilliam  at  the  South  West  Analysis  Conference,  Lafayette, 
LA. 

November  1991 

“JToo  control  for  Nonlinear  Systems,”  Invited  lecture  presented  by  Dr.  Alberto 
Isidori  at  the  University  of  California,  Berkeley,  California. 

“Lfoo  control  for  Nonlinear  Systems,”  Invited  lecture  presented  by  Dr.  Alberto 
Isidori  at  the  California  Institute  of  Technology,  Pasadena,  California. 

December  1991 

“Boundary  feedback  stabilization  for  nonlinear  distributed  parameter  systems,” 
Invited  lecture  presented  by  Dr.  David  Gilliam  at  the  30th  IEEE  Conference  on 
Decision  and  Control,  Brighton,  England, 

January  1992 

“Geometric  Methods  for  Nonlinear  Optimal  Control,”  Invited  colloquium  pre¬ 
sented  by  Dr.  Christopher  I.  Byrnes  at  Tokyo  University,  Japan. 

Febuary  1992 
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“Boundary  feedback  control  of  a  viscous  Burgers’  equation,”  Invited  lecture  pre¬ 
sented  by  Dr.  David  Gilliam  at  the  Department  of  Systems  Science  and  Mathe¬ 
matics,  Washington  University,  St.  Louis. 

March  1992 

“Root  locus  and  boundary  feedback  design  for  distributed  parameter  systems,” 
Invited  lecture  presented  by  Dr.  David  Gilliam  at  the  Department  of  Systems 
Science  and  Mathematics,  Washington  University,  St.  Louis. 

“Geometric  Methods  for  Nonlinear  Optimal  Control,”  Invited  lecture  presented 
by  Dr.  Christopher  I.  Byrnes  at  Conference  on  Nonlinear  Systems  and  Control, 
Centre  de  Physique,  Les  Houches,  France. 

UH00  control  for  Nonlinear  Systems,”  Invited  lecture  presented  by  Dr.  Alberto 
Isidori  at  the  Workshop  on  Control  Theory,  Oberwolfach,  Germany. 
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“Boundary  feedback  stabilization  of  a  controlled  Burgers’  system,”  Invited  lecture 
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Mathematics,  Virginia  Polytech  and  State  University. 
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ing,  University  of  Maryland. 
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“Geometric  Methods  for  Nonlinear  Control,”  Invited  lecture  presented  by  Dr. 
Christopher  I.  Byrnes  at  Eglin  Air  Force  Base  Guidance  and  Control  Conference, 
Eglin  AFB,  Florida. 

“Shock  Waves  for  Riccati  Equations  Arising  in  Nonlinear  Optimal  Control,”  In¬ 
vited  lecture  presented  by  Dr.  Christopher  I.  Byrnes  at  the  NSF- Washington 
University  Conference  on  Nonlinear  Systems 
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sented  by  Dr.  David  Gilliam  at  the  10th  Annual  Joint  Summer  Research  Confer¬ 
ence  in  Mathematical  Sciences:  Control  and  Identification  of  Partial  Differential 
Equations,  Mount  Holyoke  College,  South  Hadley,  Mass. 

“Shock  Waves  for  Riccati  Equations  Arising  in  Nonlinear  Optimal  Control,”  In¬ 
vited  lecture  presented  by  Dr.  Christopher  I.  Byrnes  at  the  Conference  on  Systems 
and  Feedback,  Capri,  Italy. 

“Attenuation  of  disturbances  in  nonlinear  systems,”  Invited  lecture  presented  by 
Dr.  Alberto  Isidori  at  the  Conference  on  Systems  and  Feedback,  Capri,  Italy. 

July  1992 

“Exponential  Observers  for  Nonlinear  Systems,”  Invited  lecture  presented  by  Dr. 
Christopher  I.  Byrnes  at  the  IFAC  Conference  on  Nonliear  Control,  Bordeaux, 
France. 

“Approximate  model  matching  of  nonlinear  systems,”  Invited  lecture  presented 
by  Dr.  Alberto  Isidori  at  the  IFAC  Conference  on  Nonliear  Control,  Bordeaux, 
France. 

August  1992 

“Boundary  stabilization  and  attractors  for  a  controlled  Burgers’  equation,”  Ple¬ 
nary  lecture  presented  by  Dr.  David  Gilliam  at  the  Third  Conference  on  Compu¬ 
tation  and  Control, 

Bozeman,  Montana. 

“Nonlinear  Optimal  Control  for  Nonconvex  Lagrangians,”  Plenary  lecture  pre¬ 
sented  by  Dr.  Christopher  I.  Byrnes  at  the  Third  Conference  on  Computation 
and  Control,  Bozeman,  Montana. 

September  1992 

“Convergence  of  trajectories  of  a  controlled  Burgers’  system,”  Invited  lecture 
presented  by  Dr.  David  Gilliam  at  the  SIAM  Conference  on  Control,  Minneapolis. 

“Shock  Waves  for  Riccati  Equations  Arising  in  Nonlinear  Optimal  Control,”  In¬ 
vited  lecture  presented  by  Dr.  Wei  Kang  at  the  SIAM  Conference  on  Control, 
Minneapolis. 

October  1992 
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“Shock  Waves  for  Riccati  Equations  Arising  in  Nonlinear  Optimal  Control,”  In¬ 
vited  lecture  presented  by  Dr.  Christopher  I.  Byrnes  at  SIAM  Conference  on 
Nonlinear  Dynamical  Systems,  Snowbird,  Utah. 

Invited  lecture  “Boundary  control  of  a  viscous  Burgers’  equation,”  at  North  Car¬ 
olina  State  University,  lecture  presented  by  Professor  David  S.  Gilliam. 

“Existence  and  absence  of  shock  waves  for  Riccati  and  Hamilton- Jacobi-Bellman 
equations  for  optimal  control”  Invited  lecture  at  SIAM  Conference  on  Nonlinear 
Dynamics  and  PDE’s,”  lecture  presented  by  Professor  Christopher  I.  Byrnes. 

November  1992 

“Boundary  control  of  a  viscous  Burgers’  equation,”  Invited  lecture  presented  by 
Dr.  David  Gilliam  at  the  Annual  Students  SIAM  meeting  at  Texas  Tech  Univer¬ 
sity. 

December  1992 

“Root  locus  for  distributed  parameter  systems,”  Invited  lecture  presented  by  Dr. 
David  Gilliam  at  the  Department  of  Mathematics,  University  of  Texas  Dallas. 

“L2  existence  and  local  attractors  for  Burgers’  equation,”  Invited  lecture  presented 
by  Dr.  David  Gilliam  at  the  Texas  Systems  Days. 

“Boundary  feedback  stabilization  for  a  viscous  Burgers’  equation,”  Invited  lecture 
presented  by  Dr.  David  Gilliam  at  the  31st  Conference  on  Decision  and  Control, 
Tucson. 

“On  the  nonlinear  dynamics  of  fast  filtering  algorithms,”  at  the  31st  IEEE  Con¬ 
ference  on  Decision  and  Control,  Tucson.  Invited  paper  authored  by  C.I.  Byrnes, 
A.  Lindquist,  and  Y.S.  Zhou,  lecture  presented  by  Ms.  Zhou. 

“Root-locus  and  boundary  feedback  design  for  parabolic  distributed  parameter 
systems,”  at  the  31st  IEEE  Conference  on  Decision  and  Control,  Tucson.  Invited 
paper  authored  by  C.I.  Byrnes,  D.  S.  Gilliam  and  J.  He,  lecture  presented  by  Mr. 
He. 
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January  1993 

“Poincare  technique  and  computational  nonlinear  system  control,”  Invited  lecture, 
at  the  Department  of  Mathematical  Sciences,  IUPUI,  presented  by  Professor  Wei 
Kang. 

“Stability,  observability  and  the  converse  theorem  of  Lyapunov  for  nonlinear  sys¬ 
tems,”  Invited  lecture  at  the  Department  of  Optimization  and  Systems,  Royal 
Institute  of  Technology,  Stockholm,  lecture  presented  by  Professor  Christopher 
Byrnes. 

April  1993 

uHo0  Control  via  Measurement  Feedback  for  Affine  Nonlinear  Systems,”  Invited 
lecture  at  the  University  of  Augsburg  (Germany),  lecture  presented  by  Professor 
A.  Isidori. 

May  1993 

“Necessary  Conditions  for  Nonlinear  H ^  Control  via  Measurement  Feedback,” 
Invited  lecture  at  the  University  of  California  (Santa  Barbara),  lecture  presented 
by  Professor  A.  Isidori. 

“Boundary  control  and  attractors  for  a  viscous  Burgers’  equation,”  Invited  lecture 
at  Conference  on  Nonlinear  Partial  Differential  Equations  at  Snow  Bird  Utah, 
lecture  presented  by  Professor  David  S.  Gilliam. 

“Nonlinear  Control  Systems,”  Invited  lecture  at  AFOSR  Workshop  on  Dynamics 
and  Control  at  University  of  Michigan,  Ann  Arbor,  lecture  presented  by  Professor 
Christopher  I.  Byrnes. 

June  1993 

“Regularity  of  solutions  and  attractors  for  Burgers’  equation,”  Invited  lecture  at 
University  of  Texas  at  Dallas,  lecture  presented  by  Professor  David  S.  Gilliam. 

“An  integral  invariance  principle  for  nonlinear  systems,”  Invited  lecture  at  Lab- 
oratoire  pour  Systemes  et  Signaux,  CNRS,  Gif-sur- Yvette,  lecture  presented  by 
Professor  Christopher  I.  Byrnes. 

“An  integral  invariance  principle  for  nonlinear  systems,”  Invited  lecture  at  CNRS- 
Fountainbleu,  lecture  presented  by  Professor  Christopher  I.  Byrnes. 
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“An  integral  invariance  principle  for  nonlinear  systems,”  Invited  lecture  at  Dipar- 
timento  di  Informatica  e  Sistemistica,  Universita  di  Roma  “La  Sapienza”,  lecture 
presented  by  Professor  Christopher  I.  Byrnes. 

“An  integral  invariance  principle  for  nonlinear  systems,”  Invited  lecture  at  Di- 
partimento  di  Matematica,  Universita  di  Firenza,  lecture  presented  by  Professor 
Christopher  I.  Byrnes. 

“An  integral  invariance  principle  for  nonlinear  systems,”  Invited  lecture  at  Dipar- 
timento  di  Elettronica  e  Sistemistica,  Universita  di  Padova  lecture  presented  by 
Professor  Christopher  I.  Byrnes. 

July  1993 

“An  integral  invariance  principle  for  nonlinear  systems,”  Invited  lecture  at  the 
International  Conference  on  Control  and  Estimation  of  Distributed  Parameter 
Systems:  Nonlinear  Phenomena,  Vorau,  Austria,  lecture  presented  by  Professor 
Christopher  I.  Byrnes. 

“Convergence  of  trajectories  for  a  controlled  viscous  Burgers’  equation,”  Invited 
lecture  at  the  International  Conference  on  Control  and  Estimation  of  Distributed 
Parameter  Systems:  Nonlinear  Phenomena,  Vorau,  Austria,  lecture  presented  by 
Professor  David  s.  Gilliam. 

August  1993 

“Stability,  observability  and  the  converse  theorem  of  Lyapunov  for  nonlinear  sys¬ 
tems,”  Plenary  address  at  the  1993  International  Conference  on  the  Mathemati¬ 
cal  Theory  of  Networks  and  Systems,  Regensburg,  Germany,  lecture  presented  by 
Professor  Christopher  I.  Byrnes. 

September  1993 

“Convergence  of  trajectories  for  a  boundary  controlled  viscous  Burgers’  equation,” 
Invited  lecture  presented  at  the  University  of  Texas  at  Dallas,  lecture  presented 
by  Professor  David  S.  Gilliam. 

October  1993 

“An  integral  invariance  principle  for  nonlinear  systems,”  Invited  lecture  at  the 
Department  of  Optimization  and  Systems,  Royal  Institute  of  Technology,  Stock¬ 
holm,  lecture  presented  by  Professor  Christopher  I.  Byrnes. 
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“Robust  Regulation  for  Affine  Nonlinear  Systems  Subject  to  Unstructured  Un¬ 
certainties”,  Invited  lecture  at  Boston  University,  lecture  presented  by  Professor 
Alberto  Isidori. 

“Robust  Regulation  for  Affine  Nonlinear  Systems  Subject  to  Unstructured  Un¬ 
certainties”,  Invited  lecture  at  Yale  University,  lecture  presented  by  Professor 
Alberto  Isidori. 

November  1993 

“Robust  Regulation  of  Nonlinear  Systems”,  Invited  lecture  at  the  University  of 
California,  Santa  Barbara,  lecture  presented  by  Professor  Alberto  Isidori. 

“The  effect  of  boundary  control  on  the  structure  of  stationary  solutions  for  Burg¬ 
ers’  equation,”  Invited  lecture  at  Annual  Conference  “Texas  Systems  Days”  held 
at  the  University  of  Texas  Arlington,  lecture  presented  by  Professor  David  S. 
Gilliam. 

December  1993 

“Discrete-time  lossless  systems,  feedback  equivalence  and  passivity,”  Lecture  pre¬ 
sented  at  32nd  IEEE  Conf.  Dec.  and  Control,  San  Antonio,  TX  (1993),  lecture 
presented  by  Professor  W.  Lin. 

“On  Discrete  time  Nonlinear  Control,”  Lecture  presented  at  32nd  IEEE  Conf. 
Dec.  and  Control,  San  Antonio,  TX  (1993),  lecture  presented  by  Professor  W. 
Lin. 

January  1994 

“Structure  of  stationary  solutions  for  a  controlled  viscous  Burgers’  equation,” 
Invited  lecture  presented  at  the  University  of  Texas  at  Dallas,  lecture  presented 
by  Professor  David  S.  Gilliam. 

“Structure  of  stationary  solutions  for  a  controlled  viscous  Burgers’  equation,” 
Invited  lecture  presented  at  Washington  University,  St.  Louis,  lecture  presented 
by  Professor  David  S.  Gilliam. 

February  1994 

’  Technical  briefing  at  Wright  Patterson  AFB,  Prof.  C.I.  Byrnes 
March  1994 
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“A  Complete  Parameterization  of  Positve  Rational  Covariance  Extensions,”  In¬ 
vited  lecture  at  Oberwolfach,  lecture  presented  by  Professor  C.I.  Byrnes 

“Robust  Regulation  for  Nonlinear  Systems  in  the  Presence  of  Unstructured  Per¬ 
turbations”,  Invited  lecture  at  Oberwolfach,  lecture  presented  by  Professor  Al¬ 
berto  Isidori. 

“A  Complete  Parameterization  of  Positve  Rational  Covariance  Extensions,”  In¬ 
vited  lecture  at  Universita  di  Padova,  lecture  presented  by  Professor  C.I.  Byrnes 

“Output  Regulation  in  Nonlinear  Systems”,  Invited  lecture  at  Sheffield,  lecture 
presented  by  Professor  Alberto  Isidori. 

“Nonlinear  control  and  its  applications,”  Invited  talk  in  the  Department 
of  Mathematics,  Naval  Postgraduate  School,  lecture  presented  by  Professor  W. 
Kang. 

April  1994 

•  “Structure  stationary  solutions  and  attractors  for  a  controlled  viscous  Burgers’ 
equation,”  Invited  lecture  presented  at  Texas  Partial  Differential  Equations  Con¬ 
ference  at  the  University  of  Texas  at  Austin  lecture  presented  by  Professor  David 
S.  Gilliam. 

May  1994 

“Nonlinear  H <*,  control  and  its  applications,”  Invited  talk  in  the  Department  of 
Mathematics,  California  State  Polytechnic  University,  lecture  presented  by  Pro¬ 
fessor  W.  Kang. 

“Feedback  Stabilization  About  Attractors,”  Invited  lecture  at  Eglin  Air  Force 
Base  Guidance  and  Control  Conference,  Eglin  AFB,  Florida,  lecture  presented  by 
Professor  C.I.  Byrnes 

June  1994 


“A  Complete  Parameterization  of  Positve  Rational  Covariance  Extensions,”  In¬ 
vited  lecture  at  Royal  Institute  of  Technology,  Stockholm,  lecture  presented  by 
Professor  C.I.  Byrnes 

August  1994 
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“Feedback  Stabilization  About  Attractors”  Invited  lecture  presented  at  the  fourth 
Conference  on  Computation  and  Control  held  at  Montana  State  University,  Boze¬ 
man,  Montana,  lecture  presented  by  Professor  C.I.  Byrnes 

“The  effect  of  viscousity  on  the  steady  state  behavior  of  solutions  to  Burgers’ 
equation,”  Invited  lecture  presented  at  the  fourth  Conference  on  Computation  and 
Control  held  at  Montana  State  University,  Bozeman,  Montana,  lecture  presented 
by  Professor  David  S.  Gilliam. 

September  1994 

“Feedback  Stabilization  About  Attractors  and  Inertial  Manifolds,”  Invited  lecture 
at  Royal  Institute  of  Technology,  Stockholm,  lecture  presented  by  Professor  C.I. 
Byrnes 

7  New  Discoveries 

An  important  part  of  this  research  effort  in  nonlinear  feedback  control,  documented  here, 
is  concerned  with  the  design  of  nonlinear  feedback  laws  which  stabilize  a  given  nonlinear 
control  system,  either  about  an  equilibrium  or  an  attractor.  Interest  in  the  development  of 
a  systematic  methodology  for  nonequilibrium  stabilization  is  becoming  more  widely  appre¬ 
ciated  as  the  benefits  to  taking  advantage  of  dominant  nonlinear  effects  have  become  more 
apparent.  In  a  recent  paper,  which  won  the  1993  IFAC  Automatica  Best  Paper  Award,  an 
enhancement  of  the  geometric  methodology  developed  for  the  equilibrium  case  is  applied  to 
the  derivation  of  feedback  laws  to  induce  a  stable  limit  cycle  in  the  center  manifold  of  a 
rigid  spacecraft  system  which  cannot  be  asymptotically  stabilized  about  a  reference  equi¬ 
librium,  even  by  nonlinear  feedback.  As  an  initial  general  result  in  this  research  effort,  we 
have  recently  derived  a  theorem  characterizing  the  existence  of  globally  asymptotically  stable 
compact  attractors  in  terms  of  feedback  equivalence  to  passive  systems,  for  a  suitable  choice 
of  system  output.  This  result  promises  to  have  interesting  corollaries  extending  our  previous 
application  involving  feedback  stabilization  of  limit  cycles,  as  well  as  for  more  general  attrac¬ 
tors.  Our  recent  research  in  the  development  of  methodologies  for  control  system  design  for 
lumped  nonlinear  systems  has  also  concentrated  on  the  development  of  a  systematic  theory 
of  robust  control,  both  for  structured  and  unstructured  uncertainties. 

For  lumped  nonlinear  systems,  we  have  also  made  a  significant  new  discovery,  the  inte¬ 
gral  invariance  principle,  which  generalizes  LaSalle’s  Invariance  Principle.  Not  requiring  a 
Lyapunov  or  energy  function  which  is  continuously  defined,  on  an  open  set  of  initial  condi¬ 
tions,  this  principle  can  also  apply  to  convergence  of  trajectories  to  attractors  which  are  not 
uniformly  attractive  -  such  as  arise  in  the  Lorenz  attractor. 
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Another  important  discovery  is  the  fact  that,  by  formulating  the  robust  control  problem 
in  terms  of  a  dissipation  inequality,  one  can  derive  necessary  and  sufficient  conditions  for 
the  solution  of  the  H°°  control  problem  with  measurement  feedback.  In  particular,  sufficient 
conditions  can  be  derived  for  a  separation  principle  to  hold  for  the  problems  of  H°°  state 
feedback  control  and  for  the  problem  of  robust,  or  H°°,  estimation. 

Very  significant  as  well  is  the  discovery  that,  for  optimal  control  problems  with  a  convex 
Lagrangian  (or  performance  measure),  that  uniqueness  of  the  optimal  control  problem  is 
equivalent  to  global  existence  of  the  solution  to  the  Hamilton- Jacobi- Bellman  equation.  This 
was  discovered,  under  suitable  hypotheses,  by  analyzing  the  onset  of  shocks  to  the  associated 
Riccati  PDE. 

We  have  made  unanticipated  advances  for  distributed  parameter  systems.  For  linear  par¬ 
abolic  distributed  parameter  systems,  we  have  discovered  the  distributed  parameter  analogue 
of  important  frequency  domain  constructs  such  as  high  frequency  (dc)  gain  and  a  (fractional) 
relative  degree,  expressible  in  terms  of  a  fractional  Laurent  expansion  of  the  system  transfer 
function.  This  allows  for  the  first  rigorous  development  of  root-  locus  methods  for  feedback 
design  for  this  important  class  of  distributed  parameter  systems. 

For  certain  nonlinear  distributed  parameter  systems,  we  have  discovered  the  nonlinear 
enhancement  of  root-locus  methods  for  feedback  design.  Of  considerable  practical  interest  is 
the  question  of  the  effect  of  boundary  control  in  controlling  or  influencing  the  steady-state 
response  of  forced  nonlinear  distributed  parameter  systems,  such  as  Navier- Stokes  equations, 
which  contain  both  nonlinear  convective  terms  and  diffusive  terms.  Accordingly,  we  have 
developed  design  methodologies  for  nonlinear  distributed  parameter  systems  in  the  context 
of  a  boundary  control  problem  for  the  Burgers’  equation  on  a  finite  interval.  In  this  direction, 
we  have  recently  found  significant  success  in  designing  stabilizing  boundary  feedback  control 
laws  for  a  controlled  Burgers’  equation  on  the  basis  of  a  nonlinear  enhancement  of  root-locus 
techniques.  More  explicitly,  in  our  examples,  we  compute  the  zero  dynamics  for  the  system 
and  show  that  these  dynamics  are  exponentially  stable.  In  the  language  of  lumped  nonlin¬ 
ear  control  theory,  one  would  say  that  the  nonlinear  system  is  minimum  phase.  Following 
classical  design  methods,  we  have  implemented  a  proportional  error  feedback  law,  which  we 
showed  exponentially  stabilized  the  system  for  all  sufficiently  small,  square  integrable  initial 
data.  We  have  also  been  able  to  show  that  a  nonlinear  distributed  parameter  enhancement 
of  root-locus  design  still  persists:  closed-loop  trajectories  tend  to  a  trajectory  of  the  open- 
loop  zero  dynamics  as  the  gain  parameters  are  increased  to  infinity.  Finally,  our  preliminary 
calculations  indicate  that,  for  the  unforced  Burgers’  system  there  is  a  simple  boundary  feed¬ 
back  control  law  which  renders  the  equilibrium  of  the  closed-loop  system  globally  Lyapunov 
stable,  and  which  produces  a  compact  attractor  inside  each  closed  ball. 
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8  Additional  Information 


As  described  in  Section  1  and  the  specific  research  tasks  described  in  our  proposal,  our  work 
on  distributed  parameter  control  is  a  preliminary  to  one  of  our  longer  range  research  goals, 
the  regulator  problem  for  linear  and  nonlinear  distributed  parameter  systems.  One  of  the 
motivating  applications  for  our  basic  research  in  nonlinear  control  is  flow  control,  e.g.  the 
control  of  fluid  flow  across  an  airfoil  using  thermal  actuators,  and  related  topics  such  as 
combustion  and  noise  control  currently  being  researched  in  experimental  laboratories  in  the 
United  States  and  Japan.  Here,  more  complicated  dynamical  behavior  is  exhibited  in  both 
the  process  to  be  controlled  and  the  actuator.  While  there  is  a  definite  need,  for  the  purpose 
of  control,  for  the  development  of  specific  alternative  models  to  the  Navier  Stokes  equations, 
it  is  extremely  likely  that  simplified  models  exhibiting  some  of  the  complicated  behavior  en¬ 
countered  in  turbulent  fluid  flow  will  involve  nonlinear  and  also  infinite  dimensional  systems. 
Indeed,  the  recent  “Fleming  Report”  on  Future  Directions  in  Control  Theory  emphasized 
research  on  flow  control  as  an  important  research  need  for  the  future  of  American  technology. 

The  problems  of  stabilizing  and  controlling  nonlinear  systems  are  limiting  factors  in  the 
design  of  several  DOD  systems.  For  example,  there  is  current  research  and  development  ef¬ 
fort  in  the  aerospace  industry  dedicated  toward  stabilization  and  control  of  high  performance 
aircraft  operating  in  nonlinear  flight  conditions  involving  agility  and  high  angles-of-attack. 
Because  linear  systems  exhibit  much  more  predictable  and  well-understood  behavior,  the 
control  of  linear  systems  has  been  more  highly  developed  than  the  control  of  nonlinear  sys¬ 
tems.  For  this  reason,  current  approaches  to  flight  control  in  the  presence  of  nonlinear 
effects,  e.g.  “gain  scheduling”,  have  typically  involved  finding  an  “equivalent”  linear  sys¬ 
tem,  for  which  a  controller  is  then  designed  using  existing  linear  methods.  However,  for 
more  highly  nonlinear  maneuvers  involving  increased  agility  and  higher  angle-of-attack,  the 
limitations  of  conventional  design  methods  stem  from  the  lack  of  a  reasonable  “equivalent” 
linear  system  which  incorporates  in  some  way  the  increasingly  dominant  nonlinear  effects. 
This  research  effort  in  nonlinear  stabilization  and  control  is  aimed  at  developing  a  systematic 
methodology  to  overcome  some  of  these  limitations.  The  Fleming  Report  also  emphasized 
the  importance  of  basic  problems  such  as  nonlinear  feedback  stabilization  to  the  future  of 
the  American  research  effort  in  control,  underscoring  the  earlier  consensus  of  the  1986  IEEE 
Santa  Clara  meeting  which  stated  that  “nonlinear  feedback  stabilization  is  by  far...  the  most 
important  open  problem  in  nonlinear  control.” 

The  recent  success  of  this  research  effort  in  the  solution  of  the  nonlinear  regulator  problem 
relies  heavily  on  our  earlier  AFOSR  sponsored  research  on  the  problem  of  nonlinear  feedback 
stabilization.  In  fact,  in  1987,  the  Co-PI,  Alberto  Isidori,  the  principal  investigator  was 
honored  as  a  Fellow  of  the  IEEE  for  his  contributions  to  the  foundations  of  nonlinear  control, 
an  honor  limited  to  a  small  fraction  of  the  IEEE  membership.  In  1989,  Professor  Byrnes  was 
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also  honored  as  a  Fellow  of  the  IEEE  for  his  contribution  to  feedback  stabilization  and  the 
control  of  linear  and  nonlinear  systems.  The  research  on  the  nonlinear  regulator  problem, 
and  an  application  to  hover  control  for  a  simplified  model  of  a  vertical  take-off  and  landing 
aircraft,  were  highlighted  in  the  1991  publication  of  the  AFOSR  Research  Accomplishments 
reviews.  Since  that  time,  the  foundational  paper  on  output  regulation,  which  was  published 
in  the  IEEE  Transactions  on  Automatic  Control  was  nominated  for  the  George  Axelby  Award 
for  the  best  paper  published  in  the  Transactions  in  the  years  1989-1990,  an  award  the  paper 
subsequently  won  in  December  1991  at  the  IEEE  Conference  on  Decision  and  Control  in 
Brighton,  England.  More  recently,  C.I.  Byrnes  and  A.  Isidori  won  the  1FAC  Automatica 
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